Electronic device, control method, and recording medium for displaying images based on determined state

ABSTRACT

An electronic device includes a display (display unit), a camera (imaging unit), sensors, and a controller. The controller determines the state of the electronic device on the basis of a detection result of a first sensor among the sensors. The controller causes the display to display, when the determined state is a first state, a first overlay image in which first sensor information based on a detection result of a second sensor among the sensors is overlaid on an image captured by the camera. The controller causes the display to display, when the determined state is a second state, a second overlay image in which second sensor information based on the detection result of the second sensor among the plurality of sensors is overlaid on the image captured by the camera. The second sensor information differs from the first sensor information.

CROSS-REFERENCE TO RELATED APPLICATION

This application claims priority to and benefit of Japanese PatentApplication No. 2018-020238 filed on Feb. 7, 2018, the entire contentsof which are incorporated herein by reference.

TECHNICAL FIELD

The present disclosure relates to an electronic device, a controlmethod, and a recording medium.

BACKGROUND

Electronic devices have been provided with a variety of sensors. Forexample, a known mobile device includes a camera, a barometric pressuresensor that measures the barometric pressure, a touchscreen, and acontroller. The controller infers that the mobile device is immersed inwater on the basis of a detection result of the barometric pressuresensor and infers whether the mobile device that was immersed in waterhas been removed from the water on the basis of a detection result ofthe touchscreen. The controller of the known mobile device changescontrol of the function to capture, with the camera, at least one of astill image and a moving image on the basis of the detection result ofat least one of the barometric pressure sensor and the touchscreen.

SUMMARY

An electronic device according to an aspect of the present disclosureincludes a display, a camera, a plurality of sensors, and a controller.The controller determines a state of the electronic device on the basisof a detection result of a first sensor among the plurality of sensors.The controller causes the display to display, when the determined stateis a first state, a first overlay image in which first sensorinformation based on a detection result of a second sensor among theplurality of sensors is overlaid on an image captured by the camera. Thecontroller causes the display to display, when the determined state is asecond state, a second overlay image in which second sensor informationbased on the detection result of the second sensor among the pluralityof sensors is overlaid on the image captured by the camera. The secondsensor information differs from the first sensor information.

A method according to an aspect of the present disclosure is a methodfor controlling an electronic device including a display, a camera, aplurality of sensors, and a controller. The method includes determining,using the controller, a state of the electronic device on the basis of adetection result of a first sensor among the plurality of sensors. Themethod includes causing the display to display, using the controller,when the determined state is a first state, a first overlay image inwhich first sensor information based on a detection result of a secondsensor among the plurality of sensors is overlaid on an image capturedby the camera. The method includes causing the display to display, usingthe controller, when the determined state is a second state, a secondoverlay image in which second sensor information based on the detectionresult of the second sensor among the plurality of sensors is overlaidon the image captured by the camera. The second sensor informationdiffers from the first sensor information.

A non-transitory computer-readable recording medium according to anaspect of the present disclosure includes computer program instructionsto be executed by an electronic device including a display, a camera, aplurality of sensors, and a controller. The instructions cause thecontroller to determine a state of the electronic device on the basis ofa detection result of a first sensor among the plurality of sensors. Theinstructions cause the controller to cause the display to display. whenthe determined state is a first state, a first overlay image in whichfirst sensor information based on a detection result of a second sensoramong the plurality of sensors is overlaid on an image captured by thecamera. The instructions cause the controller to cause the display todisplay, when the determined state is a second state, a second overlayimage in which second sensor information based on the detection resultof the second sensor among the plurality of sensors is overlaid on theimage captured by the camera. The second sensor information differs fromthe first sensor information.

An electronic device according to an aspect of the present disclosureincludes a display, a camera, a plurality of sensors, and a controller.The controller determines a state of the electronic device on the basisof a detection result of a first sensor among the plurality of sensors.The controller causes the display to display, when the determined stateis a first state, a first overlay image in which first sensorinformation based on a detection result of a second sensor among theplurality of sensors is overlaid on an image captured by the camera. Thecontroller causes the display to display, when the determined state is asecond state, a second overlay image in which second sensor informationbased on a detection result of a third sensor among the plurality ofsensors is overlaid on the image captured by the camera.

A method according to an aspect of the present disclosure is a methodfor controlling an electronic device including a display, a camera, aplurality of sensors, and a controller. The method includes determining,using the controller, a state of the electronic device on the basis of adetection result of a first sensor among the plurality of sensors. Themethod includes causing the display to display, using the controller,when the determined state is a first state, a first overlay image inwhich first sensor information based on a detection result of a secondsensor among the plurality of sensors is overlaid on an image capturedby the camera. The method includes causing the display to display, usingthe controller, when the determined state is a second state, a secondoverlay image in which second sensor information based on a detectionresult of a third sensor among the plurality of sensors is overlaid onthe image captured by the camera.

A non-transitory computer-readable recording medium according to anaspect of the present disclosure includes computer program instructionsto be executed by an electronic device comprising a display, a camera, aplurality of sensors, and a controller. The instructions cause thecontroller to determine a state of the electronic device on the basis ofa detection result of a first sensor among the plurality of sensors. Theinstructions cause the controller to cause the display to display, whenthe determined state is a first state, a first overlay image in whichfirst sensor information based on a detection result of a second sensoramong the plurality of sensors is overlaid on an image captured by thecamera. The instructions cause the controller to cause the display todisplay, when the determined state is a second state, a second overlayimage in which second sensor information based on a detection result ofa third sensor among the plurality of sensors is overlaid on the imagecaptured by the camera.

BRIEF DESCRIPTION OF THE DRAWINGS

In the accompanying drawings:

FIG. 1 is a functional block diagram illustrating the schematicconfiguration of an electronic device according to an embodiment;

FIG. 2 is an external view of the electronic device in FIG. 1;

FIG. 3 is an external view of the electronic device in FIG. 1 from adifferent direction;

FIG. 4 illustrates an example of mounting the electronic device in FIG.1 on a bicycle;

FIG. 5 illustrates an example of a user being equipped with theelectronic device in FIG. 1 while diving;

FIG. 6 illustrates an example of a settings screen;

FIG. 7 illustrates an example of the correspondence between exercise andsensor information that is overlaid;

FIG. 8 illustrates an example of another settings screen;

FIG. 9 illustrates an example of an overlay image displayed on a displayunit;

FIG. 10 illustrates another example of an overlay image displayed on thedisplay unit;

FIG. 11 illustrates yet another example of an overlay image displayed onthe display unit;

FIG. 12 illustrates yet another example of an overlay image displayed onthe display unit; and

FIG. 13 is a flowchart illustrating processing for controlling theelectronic device (control method).

DETAILED DESCRIPTION

Further improvements in convenience are desired for displayinginformation detected by various sensors in an electronic device. Itwould therefore be helpful to provide an electronic device, a controlmethod, and a recording medium with improved convenience. An electronicdevice, control method, and recording medium according to embodiments ofthe present disclosure can improve the convenience of displayinginformation detected by a sensor.

FIG. 1 is a functional block diagram illustrating the schematicconfiguration of an electronic device 1 according to the presentembodiment. As illustrated in FIG. 1, the electronic device 1 includes atouchscreen display 3, an imaging unit 5, a controller 6, sensors 7, anda storage 8. The components constituting these functional units arestored in or fixed to a housing 2, described below.

The touchscreen display 3 is an apparatus allowing data input by thetouching of displayed images. The touchscreen display 3 includes adisplay unit 3A and an input interface 3B. The display unit 3A isprovided with a display device such as a liquid crystal display, anorganic Electro-Luminescence (EL) panel, or an inorganic EL panel. Thedisplay unit 3A displays information such as letters, images, symbols,and graphics. The information necessary for display on the display unit3A is transmitted by the controller 6. The display unit 3A may include abacklight or the like as necessary.

The input interface 3B detects contact by a finger of the user operatingthe touchscreen display 3, a stylus, or the like. The input interface 3Bcan detect the position on the input interface 3B contacted by a finger,stylus, or the like. Any detection system may be used in the inputinterface 3B, such as a capacitive system, a resistive film system, asurface acoustic wave system (or an ultrasonic wave system), an infraredsystem, an electromagnetic induction system, a load detection system, orthe like. The signal detected by the input interface 3B is output to thecontroller 6.

The imaging unit 5 is a camera for capturing images. The imaging unit 5includes at least an optical system and an image sensor. The imagesensor captures an image by conversion into an image signal of an imageof a subject formed via the optical system on an optical detectionsurface. A Charge-Coupled Device (CCD) image sensor, a ComplementaryMetal Oxide Semiconductor (CMOS) image sensor, or the like is used asthe image sensor. The image captured by the imaging unit 5 is output tothe controller 6.

The sensors 7 detect information of a detection target. The sensors 7can detect changes in the detection target by continuously detecting thedetection target. The sensors 7 output the detected values to thecontroller 6. At least a portion of the detected values may be sensorinformation 8C, described below. In other words, at least a portion ofthe sensors 7 output information of the detection target to thecontroller 6 as sensor information 8C.

The sensors 7 include a communication sensor 7A, a position sensor 7B, adirection sensor 7C, an acceleration sensor 7D, a barometric pressuresensor 7E, and a temperature sensor 7F. A portion of these sensors maybe omitted from the sensors 7. For example, the sensors 7 need notinclude the communication sensor 7A. The sensors 7 may also include adifferent sensor.

The communication sensor 7A transmits and receives information over acommunication network. The communication sensor 7A refers to afunctional unit that is a communication interface. Information acquiredby the communication sensor 7A from an external server or the like ishandled by the controller 6 in the same way as information of the othersensors 7. The communication method that the communication sensor 7Auses to transmit and receive information is prescribed by a wirelesscommunication standard. Examples of wireless communication standardsinclude 2^(nd) Generation (2G), 3^(rd) Generation (3G), and 4thGeneration (4G). Other examples of wireless communication standardsinclude Long Term Evolution (LTE), W-CDMA, CDMA2000, PDC, Global Systemfor Mobile communications (GSM® (GSM is a registered trademark in Japan,other countries, or both)), and Personal Handy-phone System (PHS).Further examples of wireless communication standards include TheStandard for Wireless Fidelity (WiFi), Worldwide Interoperability forMicrowave Access (WiMAX), IEEE802.11, Bluetooth® (Bluetooth is aregistered trademark in Japan, other countries, or both), Infrared DataAssociation (IrDA), and Near Field radio Communication (NFC). Thecommunication sensor 7A may support one or more of the aforementionedcommunication standards.

The communication sensor 7A can acquire wind speed informationindicating the wind speed at the position of the electronic device 1from an external server or the like and output the wind speedinformation to the controller 6 as sensor information 8C. Thecommunication sensor 7A may also acquire weather information, mapinformation, mountain weather information, sea weather/wave information,snow information, sunrise/sunset information, tide information, or thelike as sensor information 8C and output this information to thecontroller 6.

The position sensor 7B acquires position information indicating theposition of the electronic device 1. For example, the position sensor 7Breceives a GPS signal from a GPS satellite indicating the position ofthe GPS satellite, the transmission time of the signal, and the like.The position sensor 7B then acquires position information indicating theposition of the electronic device 1 on the basis of the GPS signal. Theposition sensor 7B acquires the position information continuously toacquire travel path information on the basis of a history of positionsindicated by the position information. The position sensor 7B calculatesthe change in position per unit time as the speed of the electronicdevice 1 to acquire speed information indicating the calculated speed.The position sensor 7B acquires distance information indicating thetravel distance of the electronic device 1 calculated on the basis ofthe change in position. The position sensor 7B outputs the acquiredposition information, travel path information, speed information, anddistance information to the controller 6 as sensor information 8C.

The direction sensor 7C is, for example, a magnetic sensor or a gyrosensor. The direction sensor 7C acquires direction informationindicating the direction on the basis of a change in geomagnetism. Thedirection sensor 7C outputs the acquired direction information to thecontroller 6.

The acceleration sensor 7D acquires gravitational accelerationinformation indicating the gravitational acceleration of the electronicdevice 1. The acceleration sensor 7D outputs the gravitationalacceleration information to the controller 6 as sensor information 8C.

The barometric pressure sensor 7E acquires barometric pressureinformation indicating the barometric pressure of the surroundingenvironment of the electronic device 1. The barometric pressure sensor7E outputs the barometric pressure information to the controller 6 assensor information 8C. As described below, the controller 6 cancalculate height information of the location of the electronic device 1on the basis of the acquired barometric pressure information. Thebarometric pressure sensor 7E may be individually waterproofed.

The temperature sensor 7F acquires temperature information indicatingthe temperature of the surrounding environment of the electronic device1. The temperature sensor 7F also outputs the temperature information tothe controller 6 as sensor information 8C.

The storage 8 stores a program 8A, setting information 8B, sensorinformation 8C, and image information 8D. The storage 8 may also be usedas a working area to store results of processing by the controller 6temporarily. The storage 8 may include any appropriate storage device,such as a semiconductor storage device or a magnetic storage device. Thestorage 8 may also include a plurality of types of storage devices. Thestorage 8 may include a combination of a portable storage medium, suchas a memory card, and an apparatus for reading the storage medium.

The program 8A is a program for controlling the electronic device 1. Theelectronic device 1 executes various functions by the controller 6following the instructions of the program 8A. The program 8A may beinstalled on the storage 8 through wireless communication via thecommunication sensor 7A or from a storage medium. The program 8Aincludes an overlay application for the controller 6 to execute overlayprocessing. Here, overlay processing includes processing to generate anoverlay image by overlaying the sensor information 8C on an imagecaptured by the imaging unit 5. The overlay processing also includesprocessing to store the overlay image in the storage 8 as the imageinformation 8D on the basis of the setting information 8B. In thepresent disclosure, an “application” is short for an applicationprogram.

The setting information 8B is information on settings related to overlayprocessing designated by the user. The setting information 8B includesthe table described below, for example.

The sensor information 8C is information acquired by the controller 6from the sensors 7 and information generated on the basis of informationacquired by the controller 6 from the sensors 7. In the presentembodiment, the sensor information 8C is information that changes overtime in accordance with changes in the state (for example, thesurrounding environment) of the electronic device 1. The sensorinformation 8C is, for example, position information, travel pathinformation, speed information, distance information, directioninformation, gravitational acceleration information, barometric pressureinformation, height information, temperature information, and the like.The sensor information 8C is not limited to the above types ofinformation and may, for example, further include wind speedinformation, weather information, map information, mountain weatherinformation, sea weather/wave information, snow information,sunrise/sunset information, tide information, and the like.

The image information 8D is information of images on which overlayprocessing has been performed. The image information 8D includes stillimages and moving images. The controller 6 can, for example, read theimage information 8D from the storage 8 (such as a video on whichoverlay processing has been performed) and cause the image information8D to be displayed on the touchscreen display 3.

The controller 6 may, for example, be a Central Processing Unit (CPU).The controller 6 may be a System-on-a-Chip (SoC) or other type ofintegrated circuit in which other components, such as the communicationsensor 7A, are integrated. The controller 6 may be configured bycombining a plurality of integrated circuits. The controller 6 controlsthe functional units of the electronic device 1 and implements a varietyof functions by comprehensively controlling operations of the electronicdevice 1. Details of the operations of the controller 6 in the presentembodiment are provided below.

The electronic device 1 of the present embodiment generates an image(overlay image) by overlaying sensor information 8C on a captured imageand displays the overlay image on a display as a preview image. Theelectronic device 1 of the present embodiment can store the overlayimage displayed on the display unit 3A in the storage 8. The electronicdevice 1 of the present embodiment overlays the sensor information 8C onthe captured image when the image is captured. Furthermore, theelectronic device 1 of the present embodiment stores the image with thesensor information 8C overlaid thereon. Consequently, the electronicdevice 1 of the present embodiment allows the user to reliably storecaptured images in real time after visually confirming that the sensorinformation 8C is overlaid on the captured image in a desired form(position, size, and the like).

FIG. 2 is an external view of the electronic device 1. The electronicdevice 1 may, for example, be a smartphone but is not limited to being asmartphone. The electronic device 1 may, for example, be a featurephone, a tablet, or the like. The electronic device 1 may also be animaging apparatus equipped with sensors, such as a digital camera or anaction camera.

FIG. 2 illustrates the front of the electronic device 1, where thetouchscreen display 3 is located. The housing 2 forms the outside of theelectronic device 1 and protects the components of the electronic device1, such as the touchscreen display 3, that are stored in or fixed to thehousing 2. As illustrated in FIG. 2, a portion of the imaging unit 5(for example, a front camera) is provided on the front of the electronicdevice 1. The imaging unit 5 need not be provided on the front of theelectronic device 1.

FIG. 3 illustrates the back of the electronic device 1, which is theopposite side from the front. As illustrated in FIG. 3, a portion of theimaging unit 5 (for example, a back camera) is provided on the back ofthe electronic device 1.

The electronic device 1 may, for example, be used while attached to thehandlebars of a bicycle 100, as illustrated in FIG. 4. In this case, theelectronic device 1 is attached with the imaging unit 5 facing anydirection desired by the user, for example to capture images in thetravel direction of the bicycle 100. The electronic device 1 is attachedso as to allow the user to visually confirm the touchscreen display 3.Therefore, the user can, in real time, confirm images captured by theimaging unit 5 while the user is riding the bicycle 100.

The electronic device 1 may be held and used by the user whileexercising. For example, the user can use the electronic device 1 whilediving by holding an auxiliary apparatus 9 to which the electronicdevice 1 is attached, as illustrated in FIG. 5. In this case, theelectronic device 1 is held so that the imaging unit 5 captures imagesin a direction desired by the user, such as the user's travel direction.The user can, for example, visually confirm the touchscreen display 3 ofthe electronic device 1 while holding the electronic device 1 andauxiliary apparatus 9 so that the imaging unit 5 captures images in theuser's travel direction, as illustrated in FIG. 5. This allows the userto visually confirm, in real time, images captured by the imaging unit 5while the user is exercising.

As described above, the controller 6 performs overlay processing withthe overlay application. An overlay image in which the sensorinformation 8C is overlaid on the image captured by the imaging unit 5is displayed on the display unit 3A by the overlay processing. Theoverlay image is also stored in the storage 8 by the overlay processing.The sensor information 8C overlaid on the captured image is selected bythe user using the settings screen, described below.

FIG. 6 illustrates an example of a settings screen. Before thecontroller 6 starts the overlay processing, the user selects the sensorinformation 8C to be overlaid on the captured image using the settingsscreen in FIG. 6. The settings screen in FIG. 6 can, for example, bedisplayed by selection from a menu on an initial screen (top screen) ofthe electronic device 1.

The settings screen in FIG. 6 is for selecting the situation where theelectronic device 1 is to be used. Specifically, the settings screen isfor selecting what type of exercise the user will be doing when usingthe electronic device 1. The types of exercise selectable on thesettings screen in FIG. 6 are “surfing/marine sports”, “hiking”,“skiing/snowboarding”, “cycling”, “fishing”, “trekking”, “diving”, and“triathlon”. The user selects one type of exercise by touching a radiobutton. The selected type of exercise is stored in the storage 8 as onepiece of setting information 8B.

FIG. 7 illustrates an example of the correspondence between exercise(use) and the sensor information 8C that is overlaid on the capturedimage. In the table in FIG. 7, circles indicate correspondence betweentypes of exercise and pieces of sensor information 8C. The table in FIG.7 is stored in the storage 8 as one piece of setting information 8B.

The controller 6 reads the type of exercise selected by the user fromthe setting information 8B. The controller 6 then reads the table inFIG. 7 from the setting information 8B and determines the sensorinformation 8C corresponding to the selected type of exercise. Forexample, when the type of exercise selected by the user is fishing, thecontroller 6 determines that the sensor information 8C to be overlaid ona captured image is barometric pressure information, wind speedinformation, and temperature information. The controller 6 causes thedisplay to display an overlay image in which the barometric pressureinformation, wind speed information, and temperature information isoverlaid on a captured image. When instructed by the user, thecontroller 6 stores the overlay image.

On the basis of the table associating exercise and sensor information 8Cto be overlaid on a captured image, the sensor information 8C isautomatically determined in accordance with the type of exerciseselected by the user. Therefore, the user can easily determine thesensor information 8C by simply selecting the situation in which theelectronic device 1 is to be used (in the present embodiment, theexercise the user is going to perform).

Here, the settings screen may use checkboxes instead of radio buttons.In this case, the user can select one or more types of exercise. Thecontroller 6 then overlays all of the sensor information 8Ccorresponding to the one or more selected types of exercise on acaptured image.

The sensor information 8C to be overlaid on the captured image need notbe restricted to the items of the sensor information 8C in theaforementioned table (speed information, distance information, heightinformation, gravitational acceleration information, barometric pressureinformation, travel path information, wind speed information, directioninformation, and temperature information). The controller 6 may furtheroverlay current time information on the captured image regardless of thetype of exercise selected by the user. The controller 6 may furtheroverlay position information on the captured image regardless of thetype of exercise selected by the user. The controller 6 may furtheroverlay elapsed time information on the captured image regardless of thetype of exercise selected by the user. This information indicates thetime elapsed from the start of storage of an overlay image that is amoving image.

FIG. 8 illustrates an example of another settings screen. In thisexample, the settings screen allows the user to individually select thesensor information 8C. As illustrated in FIG. 8, each type of sensorinformation 8C is displayed along with a checkbox on the settingsscreen. The user selects one or more types of sensor information 8C tooverlay on the captured image by touching the checkboxes. The selectedtypes of sensor information 8C are stored in the storage 8 as one pieceof setting information 8B. The controller 6 reads the sensor information8C selected by the user from the setting information 8B. The controller6 causes the display to display an overlay image on which the selectedsensor information 8C is overlaid. When instructed by the user, thecontroller 6 stores the overlay image.

When the settings screen in FIG. 8 is used, the user can individuallyset the sensor information 8C to be overlaid on the captured image.Users can therefore customize the overlay image to suit theirpreferences.

As yet another example, the settings screen in FIG. 6 (first settingsscreen) and the settings screen in FIG. 8 (second settings screen) maybe used together. The user can cause the first settings screen or thesecond settings screen to be displayed using a menu on the initialscreen of the electronic device 1, for example. The user first selects atype of exercise on the first settings screen. The selected type ofexercise is stored in the storage 8 as one piece of setting information8B. The controller 6 reads the type of exercise selected by the userfrom the setting information 8B. The controller 6 then reads the tablein FIG. 7 from the setting information 8B and determines the sensorinformation 8C corresponding to the selected type of exercise. Thecontroller 6 sets the checkboxes of the second settings screen to adefault selection of the sensor information 8C corresponding to theselected type of exercise. In other words, the controller 6 storesinitial values of the checkboxes of the second settings screen based onthe selected type of exercise as one piece of setting information 8B.The user then selects or deselects sensor information 8C by touching thecheckboxes on the second settings screen. The user can therefore adjustthe sensor information 8C on the second settings screen.

For example, the user may select surfing/marine sports on the firstsettings screen. The controller 6 reads the table illustrated in FIG. 7and sets the speed information, distance information, gravitationalacceleration information, wind speed information, and temperatureinformation as the types of sensor information 8C initially selected onthe second settings screen. The controller 6 then causes the secondsettings screen to be displayed in response to a user operation. At thistime, the checkboxes for the speed information, distance information,gravitational acceleration information, wind speed information, andtemperature information are selected on the second settings screen. Theuser can select additional sensor information 8C or deselect sensorinformation 8C on the second settings screen. For example, if the userdeselects the gravitational acceleration information, wind speedinformation, and temperature information, then only the speedinformation and distance information remain selected. In this way, theuser can use the second settings screen to adjust the sensor information8C corresponding to the type of exercise selected on the first settingsscreen. The user can therefore easily customize the sensor information8C to be overlaid on the captured image.

After the sensor information 8C to be overlaid on the captured image isset, the controller 6 executes the overlay processing when the userperforms a predetermined operation to initiate the overlay processing.An example of the predetermined operation is the touching of apredetermined object displayed on the touchscreen display 3.

When instructed to initiate the overlay processing, the controller 6acquires the sensor information 8C to be overlaid on a captured imagefrom the storage 8. The controller 6 then generates an overlay image byoverlaying the sensor information 8C on the captured image. Thecontroller 6 causes the display unit 3A to display the generated overlayimage.

FIG. 9 illustrates an example of an overlay image displayed on thedisplay unit 3A. In the example in FIG. 9, the user is riding thebicycle 100. The electronic device 1 is used while attached to thehandlebars of the bicycle 100.

The controller 6 causes the display to display an overlay image in whichvarious information (speed information D1, distance information D2,gravitational acceleration information D4, current time information D5,temperature information D11, and height information D12) is overlaid ona captured image. As illustrated in FIG. 9, the various informationoverlaid on the captured image may be sensor information 8C thatincludes numerical information. The numerical information is informationthat changes over time. The various information overlaid on the capturedimage may be sensor information 8C that includes text information. Thetext information indicates the specific content of the numericalinformation.

For example, the gravitational acceleration information D4 illustratedin FIG. 9 is one type of sensor information 8C. The gravitationalacceleration information D4 includes the numerical information “1.2(G)”. The gravitational acceleration information D4 also includes thetext information “G-FORCE”. The numerical information “1.2 (G)” in thegravitational acceleration information D4 changes over time. The textinformation “G-FORCE” indicates that “1.2 (G)” is the value ofgravitational acceleration. The temperature information D11 illustratedin FIG. 9, for example, is also one type of sensor information 8C. Thetemperature information D11 includes the numerical information “31° C.”.The temperature information D11 includes the text information “outsidetemperature”. The numerical information in the temperature informationD11 changes over time. The text information “outside temperature”indicates that “31° C.” is the outside temperature.

The controller 6 may arrange the information (speed information D1,distance information D2, gravitational acceleration information D4,current time information D5, temperature information D11, and heightinformation D12) at appropriate positions to avoid disturbing the user'sexercise. In the example in FIG. 9, the user is riding the bicycle 100.Information is therefore preferably not overlaid on the central andupper central portions of the display unit 3A, where the road in thedirection of travel is displayed. Rather, information is preferablydisplayed at the lower portion or near the sides of the captured image,as illustrated in FIG. 9.

Objects for user operation (at least one of a still image storage objectO1, a moving image storage object O2, and an end object O3) are alsodisplayed in the overlay image. The controller 6 causes the still imagestorage object O1, for example, to be displayed on the touchscreendisplay 3. The overlay image is stored as a still image when the usertouches the still image storage object O1. The controller 6 also causesthe moving image storage object O2, for example, to be displayed on thetouchscreen display 3. The overlay image is stored as a moving imagewhen the user touches the moving image storage object O2. The controller6 causes the end object O3, for example, to be displayed on thetouchscreen display 3 when storage of the moving image begins. Storageof the moving image ends when the user touches the end object O3. Theend object O3 may be displayed instead of the still image storage objectO1 and the moving image storage object O2. Unlike the informationoverlaid on the captured image (such as the speed information D1), theobjects for user operation are not stored in the storage 8. In otherwords, objects are not displayed when the controller 6 reads the imageinformation 8D from the storage 8 and causes the image information 8D tobe displayed on the touchscreen display 3 (i.e. during reproduction).Information such as the speed information D1 and the distanceinformation D2, for example, is displayed during reproduction.

FIG. 10 illustrates another example of an overlay image displayed on thedisplay unit 3A. FIG. 10 illustrates an overlay image displayed aftertime has elapsed from the state in FIG. 9. As illustrated in FIG. 10,the information overlaid on the captured image may change (in thisexample, increase) over time. The controller 6 may overlay elapsed timeinformation D6, indicating the time elapsed from the start of storage ofthe overlay image (moving image), on the captured image. The controller6 may also overlay maximum speed information D7, indicating the maximumspeed attained from the start of storage of the overlay image, on thecaptured image. The controller 6 may also overlay maximum gravitationalacceleration information D8, indicating the maximum gravitationalacceleration attained from the start of storage of the overlay image, onthe captured image. The controller 6 may also overlay travel pathinformation D9 on the captured image. The travel path information D9includes an object showing a history, based on position information, ofpositions in actual space (the travel path). The object is reduced to bedisplayable in a predetermined region R.

The electronic device 1 is not limited to being used during exercise onlevel terrain (such as cycling) but may also be used during exercise onmountainous terrain (such as hiking) and underwater exercise (such asdiving). For example, the barometric pressure sensor 7E detects thebarometric pressure on level terrain and mountainous terrain and detectsthe water pressure underwater. In other words, the detected value (suchas pressure) of one sensor 7 may have different names depending on theusage conditions of the electronic device 1. The communication sensor7A, for example, acquires weather information, mountain weatherinformation, and sea weather/wave information. Wind speed informationbased on the mountain weather information is useful during exercise onmountainous terrain (such as hiking). Information on the current, basedon the sea weather/wave information, is useful during underwaterexercise (such as diving). In other words, information from one sensor 7needs to be appropriately selected in accordance with the usageconditions of the electronic device 1.

The information included in the overlay image (such as the temperatureinformation D11) needs to be corrected when the information does notmatch the usage conditions of the electronic device 1. The user can alsocorrect the information manually when the information does not match theusage conditions of the electronic device 1. Manual correction by theuser is not practical, however, when the usage environment of theelectronic device 1 changes dynamically (for example, during atriathlon) and when underwater, where it is generally difficult toperform precise operations on the touchscreen display 3 (for example,while diving).

As described below, the electronic device 1 of the present embodimentdetermines the usage environment and changes the display form so thatappropriate information is included in the overlay image automatically.

FIG. 11 illustrates an example of an overlay image displayed on thedisplay unit 3A. In the example in FIG. 11, the user is diving. The userhas selected the temperature information, height information, and windspeed information in advance on the settings screen. Consequently, theoverlay image in FIG. 11 includes temperature information D11, heightinformation D12, and wind speed information D13. In the example in FIG.12, the user is hiking. The sensor information 8C selected by the useron the settings screen is the same as in FIG. 11. Consequently, theoverlay image in FIG. 12 includes temperature information D11, heightinformation D12, and wind speed information D13.

As illustrated in FIG. 11 and FIG. 12, the text information of thetemperature information D11, height information D12, and wind speedinformation D13 is appropriately displayed in accordance with the usageenvironment of the electronic device 1. The text information of thetemperature information D11 in FIG. 11 is “water temperature”, since theelectronic device 1 is being used underwater. The text information ofthe temperature information D11 in FIG. 12 is “outside temperature”,since the electronic device 1 is being used in mountainous terrain. Thetext information of the height information D12 in FIG. 11 is “waterdepth”, since the electronic device 1 is being used underwater. The textinformation of the height information D12 in FIG. 12 is “elevation”,since the electronic device 1 is being used in mountainous terrain. Thetext information of the wind speed information D13 in FIG. 11 is“current”. The text information of the wind speed information D13 inFIG. 12 is “wind speed”.

The controller 6 determines the state of the electronic device 1 on thebasis of the detection result of a first sensor (such as the barometricpressure sensor 7E) among the plurality of sensors 7. In the examples inFIG. 11 and FIG. 12, the controller 6 determines that the usageenvironment of the electronic device 1 has changed from being on ground(level or mountainous terrain) to underwater when a change in pressuredetected by the barometric pressure sensor 7E during a predeterminedtime (such as one minute) exceeds a predetermined value (such as 100hPa). The pressure change on the ground is gradual, and a change of atleast a predetermined value in a predetermined time is nearlyimpossible. Therefore, the controller 6 can determine that the usageenvironment has changed from being on ground to underwater when thepressure rises by more than a predetermined value in a predeterminedtime. The controller 6 can also determine that the usage environment haschanged from being underwater to on ground when the pressure drops bymore than a predetermined value in a predetermined time.

When the determined state is a first state (such as the electronicdevice 1 not being underwater), the controller 6 causes the display(display unit 3A) to display a first overlay image in which first sensorinformation based on the detection result of one or more second sensorsamong the plurality of sensors (such as the communication sensor 7A,barometric pressure sensor 7E, and temperature sensor 7F) is overlaid onan image captured by the camera (imaging unit 5). An example of thefirst overlay image is illustrated in FIG. 12. In the example in FIG.12, the electronic device 1 is in the first state of not beingunderwater, and the text information of the temperature information D11,height information D12, and wind speed information D13, which are thefirst sensor information, is respectively “outside temperature”,“elevation”, and “wind speed”.

When the determined state is a second state (such as the electronicdevice 1 being underwater), the controller 6 causes the display (displayunit 3A) to display a second overlay image in which second sensorinformation based on the detection result of one or more second sensorsamong the plurality of sensors (such as the communication sensor 7A,barometric pressure sensor 7E, and temperature sensor 7F) is overlaid onan image captured by the camera (imaging unit 5). The second sensorinformation differs from the first sensor information. An example of thesecond overlay image is illustrated in FIG. 11. In the example in FIG.11, the electronic device 1 is in the second state of being underwater,and the text information of the temperature information D11, heightinformation D12, and wind speed information D13, which are the secondsensor information, is respectively “water temperature”, “water depth”,and “current”. In other words, the text information differs between thefirst sensor information and the second sensor information.

The controller 6 may calculate the numerical information of the firstsensor information and the numerical information of the second sensorinformation with different calculation methods. For example, when theelectronic device 1 is being used underwater, the water depth increasesby 10 m for a rise in pressure of approximately 1 atmosphere. When theelectronic device 1 is used in mountainous terrain, the elevationincreases by 100 m for a drop in pressure of approximately 10 hPa.Calculations related to the height information D12 may be updated inaccordance with the state of the electronic device 1 (the usageenvironment of the electronic device 1). In other words, the calculationmethod used by the controller 6 may differ between calculation of thewater depth and calculation of elevation from the detection result ofthe barometric pressure sensor 7E (pressure). The calculation method forthe height information D12 therefore differs between the first sensorinformation and the second sensor information, resulting in differentnumerical information. In the example in FIG. 11, the electronic device1 is in the second state of being underwater, and the numericalinformation of the height information D12, which is second sensorinformation, is “10 (m)”. In the example in FIG. 12, the electronicdevice 1 is in the first state of not being underwater, and thenumerical information of the height information D12 is “1000 (m)”.

In the examples in FIG. 11 and FIG. 12, there is only one first sensor(barometric pressure sensor 7E). The first sensor may, however, includea plurality of sensors 7. For example, the controller 6 may use thedetection results of the barometric pressure sensor 7E and the positionsensor 7B to determine the state of the electronic device 1. Thecontroller 6 may use the detection result of the position sensor 7B todetermine whether the electronic device 1 is located in an ocean or ariver on a map and use this information in determining the state of theelectronic device 1. In the examples in FIG. 11 and FIG. 12, the secondsensor includes a plurality of sensors 7. The second sensor may,however, be only one sensor 7.

In the examples in FIG. 11 and FIG. 12, the barometric pressure sensor7E is used as the first sensor for determining the state of theelectronic device 1 and as the second sensor for overlaying the sensorinformation 8C on the captured image. The first sensor, however, neednot include the same sensors 7 as the sensors 7 included in the secondsensor. In other words, the one or more sensors 7 included in the firstsensor and the one or more sensors 7 included in the second sensor neednot overlap. For example, the second sensor need not include thebarometric pressure sensor 7E.

In the present embodiment, the controller 6 continues to acquire thedetection result of the first sensor during execution of the overlayprocessing and determines the state of the electronic device 1 on thebasis of the detection result. At this time, the type of exerciseselected by the user in advance on the settings screen, for example,does not particularly affect the determination of the state of theelectronic device 1. However, the controller 6 may instead suspend thedetermination of the state of the electronic device 1 or restrict thetiming of the determination in accordance with the user selection. Forexample, when the type of exercise the user selects in advance on thesettings screen is assumed not to take place underwater (such as hiking,skiing/snowboarding, or cycling), the controller 6 may suspenddetermination of the state of the electronic device 1 or increase thetime interval for determining the state of the electronic device 1. Thiscan reduce the processing load of the controller 6.

FIG. 13 is a flowchart illustrating an example method for controllingthe electronic device 1 of the present embodiment. The electronic device1 starts the overlay processing when the user performs a predeterminedoperation (such as touching a predetermined icon). In accordance withthe flowchart in FIG. 13, the controller 6 generates an overlay imagecorresponding to the determined state of the electronic device 1 andcauses the display unit 3A to display the overlay image.

First, the controller 6 acquires an image captured by the imaging unit 5(step S1).

The controller 6 acquires the detection result of the first sensor (stepS2). The first sensor is, for example, the barometric pressure sensor7E. At this time, the detection result is the value of the barometricpressure (pressure) of the surrounding environment of the electronicdevice 1. The controller 6 determines the state of the electronic device1 on the basis of a change in the barometric pressure (pressure) of thesurrounding environment of the electronic device 1 during apredetermined time.

When the determined state is the first state (step S3: Yes), thecontroller 6 proceeds to step S4. The first state is, for example, astate in which the electronic device 1 is not underwater.

The controller 6 generates the first overlay image on which the firstsensor information is overlaid (step S4). The first sensor informationis information such as the temperature information D11 (“outsidetemperature: −10° C.”), height information D12 (“elevation: 1000 m”),and wind speed information D13 (“wind speed: 2 m/s”) in FIG. 12.

The controller 6 causes the display unit 3A to display the first overlayimage (step S5). Here, the user can store the first overlay image as astill image by touching the still image storage object O1. By touchingthe moving image storage object O2, the user can also store the firstoverlay image as a moving image until touching the end object O3.

When the determined state is not the first state, i.e. when thedetermined state is the second state (step S3: No), the controller 6proceeds to step S6. The second state is, for example, a state in whichthe electronic device 1 is underwater.

The controller 6 generates the second overlay image on which the secondsensor information is overlaid (step S6). The second sensor informationis information such as the temperature information D11 (“watertemperature: 20° C.”), height information D12 (“water depth: 10 m”), andwind speed information D13 (“current: 0.4 knots”) in FIG. 11. In thesecond sensor information, the text information such as watertemperature, water depth, and current differs from the text informationof the first sensor information in accordance with the electronic device1 being in the second state (underwater). In other words, the displayform of at least the text information of the second sensor informationdiffers from the first sensor information.

The controller 6 causes the display unit 3A to display the secondoverlay image (step S7). Here, the user can store the second overlayimage as a still image by touching the still image storage object O1. Bytouching the moving image storage object O2, the user can also store thesecond overlay image as a moving image until touching the end object O3.

The electronic device 1 of the present embodiment thus determines thestate of the electronic device 1 on the basis of the detection result ofthe first sensor. The electronic device 1 automatically changes thedisplay form of information detected by the sensors 7 in accordance withthe state of the electronic device 1, without the need for the user tomake manual corrections. Consequently, the electronic device 1 of thepresent embodiment improves the convenience of displaying informationdetected by the sensors. Having the electronic device 1 automaticallychange the display form of information detected by the sensors withoutthe need for user operation is particularly useful in situations wherethe usage environment of the electronic device 1 can change dynamically,such as when the user is participating in a triathlon.

Although the subject matter of the present disclosure has been describedwith reference to the drawings and embodiments, it is to be noted thatvarious changes and modifications will be apparent to those skilled inthe art on the basis of the present disclosure. Therefore, such changesand modifications are to be understood as included within the scope ofthe present disclosure. For example, the functions and the like includedin the various components, steps, and the like may be reordered in anylogically consistent way. Furthermore, components, steps, and the likemay be combined into one or divided.

The information included in the sensor information 8C may be generatedby a different method than in the above embodiment. For example, thecontroller 6 may acquire the position information from the positionsensor 7B and calculate the distance information on the basis of achange in the position. The controller 6 may generate the speedinformation by acquiring the value detected by the acceleration sensor7D and integrating the effective acceleration component. In other words,the sensor information 8C may be generated by a functional block otherthan the sensors 7, such as the controller 6, that acquires the detectedvalues of the sensors 7.

In the above embodiment, the overlay image is an appropriate image forwhen the user is exercising. The overlay image need not, however, berelated to exercise. For example, the overlay image may changeautomatically when the user is moving in a vehicle. The controller 6 canoverlay the travel path information on the captured image in a firstcolor when the determined state is the first state (such as riding atrain above ground) on the basis of the detection result of thebarometric pressure sensor 7E. The controller 6 can overlay the travelpath information on the captured image in a second color when thedetermined state is the second state (such as riding a subway) on thebasis of the detection result of the barometric pressure sensor 7E.

The overlay image may, for example, change automatically in accordancewith whether the user is inside or outside. When the determined state isthe first state (for example, outside), the controller 6 sets the textinformation of the temperature information D11 overlaid on the capturedimage to “outside temperature”. When the determined state is the secondstate (for example, inside), the controller 6 sets the text informationof the temperature information D11 overlaid on the captured image to“indoor temperature”.

The controller 6 can determine whether the user is inside or outside onthe basis of whether the communication sensor 7A has transmitted orreceived information using an access point in the home or workplace, forexample. When the sensors 7 include an illuminance sensor that detectsthe illuminance of surrounding light, the controller 6 can determinewhether the user is inside or outside on the basis of the detected valueof the illuminance sensor. For example, the controller 6 may determinethat the user is outside when the detected value of the illuminancesensor exceeds a threshold of 2000 lux, which corresponds to theilluminance on a cloudy day approximately one hour after sunrise. Whenthe sensors 7 include a gas sensor that detects volatile organiccompounds (VOC), the controller 6 can determine whether the user isinside or outside on the basis of the detected value of the gas sensor.For example, the controller 6 may determine that the user is outsidewhen the detected value of the gas sensor exceeds a threshold of 0.06ppm in one hour.

The overlay image may, for example, change automatically in accordancewith whether the vehicle that the user is riding is a train. When thedetermined state is the first state (for example, riding a train), thecontroller 6 overlays an index related to the surrounding environment onthe captured image as a “discomfort index”. When the determined state isthe second state (for example, riding a car or the like), the controller6 overlays an index related to the surrounding environment on thecaptured image as a “rest index”. The index related to the surroundingenvironment may be calculated on the basis of the detected values of asensor that measures humidity and the temperature sensor 7F. Thedetected value of a gas sensor that measures the concentration of carbondioxide, for example, may be used in the calculation of the indexrelated to the surrounding environment.

When the sensors 7 include a geomagnetic sensor, the controller 6 candetermine whether the vehicle that the user is riding is a train on thebasis of the detected value of the geomagnetic sensor. When thegeomagnetic sensor detects a magnetic field produced by high-voltagepower lines supplying a train, the controller 6 can determine that theuser is riding a train.

In the above embodiment, the first sensor information overlaid on thecaptured image is based on the detection result of the second sensorwhen the determined state is the first state. The second sensorinformation overlaid on the captured image is based on the detectionresult of the second sensor when the determined state is the secondstate as well. Here, second sensor information based on the detectionresult of a third sensor that differs from the second sensor may be usedwhen the determined state is the second state. In the presentmodification, the first sensor information and the second sensorinformation are based on the detection results of different sensors. Thetext information and the numerical information therefore differ betweenthe first sensor information and the second sensor information in thepresent modification.

The second sensor may, for example, include the acceleration sensor 7Dor the position sensor 7B. The third sensor may, for example, includethe temperature sensor 7F or the barometric pressure sensor 7E. Like thefirst sensor and the second sensor, the third sensor may include aplurality of sensors 7.

When the user is participating in a triathlon, for example, and isriding a bicycle, the controller 6 determines that the electronic device1 is in the first state (not underwater). At this time, the first sensorinformation based on the detection result of the second sensor (forexample, the acceleration sensor or position sensor) is the speedinformation or position information of the bicycle. When the user isswimming, the controller 6 determines that the electronic device 1 is inthe second state (underwater). At this time, the second sensorinformation based on the detection result of the third sensor (forexample, the temperature sensor 7F or barometric pressure sensor 7E) isthe water temperature or water pressure. The speed information (orposition information) is useful when the electronic device 1 is in thefirst state (not underwater) but may become unnecessary when theelectronic device 1 is in the second state (underwater). In the presentmodification, the water temperature (or water pressure) based on thedetection result of the third sensor, which differs from the secondsensor, is automatically displayed when the electronic device 1 is inthe second state. Therefore, the user can acquire information that isappropriate (useful) for the circumstances from the electronic device 1.At this time, the user does not change settings manually. Consequently,the electronic device 1 of the present modification improves theconvenience of displaying information detected by the sensor.

The display of the first sensor information based on the detectionresult of the second sensor and the display of the second sensorinformation based on the detection result of the third sensor may, forexample, automatically change depending on whether the user is walkingor riding a vehicle (such as a bicycle or a car). When the determinedstate is walking, the controller 6 can display the number of steps (anexample of first sensor information) based on the detection result ofthe acceleration sensor 7D. When the determined state is riding, thecontroller 6 can display the speed (an example of second sensorinformation) based on the detection result of the position sensor 7B.The controller 6 can determine whether the user is walking or riding onthe basis of the acceleration detected by the acceleration sensor 7D,for example.

When the sensors 7 include a geomagnetic sensor that detects themovement direction of the user, the controller 6 can determine whetherthe user is walking, riding a bicycle, or riding in a car on the basisof the detected values of the geomagnetic sensor and the accelerationsensor 7D. For example, the controller 6 detects the speed at the timeof a change in the movement direction (such as a direction change of90°). The controller 6 can identify the change in the movement directionon the basis of the detected value of the geomagnetic sensor. The speedcan also be obtained by integrating the acceleration detected by theacceleration sensor 7D. When, for example, the speed at the time of adirection change of 90° exceeds a first threshold (such as 20 km/h), thecontroller 6 determines that the user is riding in a car. When the speedat the time of a direction change of 90° is equal to or less than thefirst threshold and exceeds a second threshold (such as 8 km/h), thecontroller 6 determines that the user is riding a bicycle. When thespeed at the time of a direction change of 90° is equal to or less thanthe second threshold (such as 8 km/h), the controller 6 determines thatthe user is walking.

The controller 6 may switch a display of calorie consumption, which isbased on the travel path information, on or off when the controller 6 iscapable of determining whether the user is riding a bicycle or riding ina car. For example, the controller 6 may display the calorie consumptiononly when the user is riding a bicycle. In other words, the controller 6may execute further changes in the display form (such as switching thedisplay of a portion of information on or off) on the basis of thedetected values of the sensors 7.

When the sensors 7 include a UV sensor that detects ultraviolet light,for example, the controller 6 may switch a display of the detected valueof the UV sensor on or off in accordance with whether the user is insideor outside. For example, the controller 6 may display the detected valueof the UV sensor only when the user is outside. The controller 6 mayalso switch a display of coupon information on or off in accordance withwhether the user is inside a predetermined store. The user can bedetermined to be inside the predetermined store on the basis of theposition information. The coupon information usable in the predeterminedstore can be acquired by the communication sensor 7A and stored in thestorage 8. The controller 6 may also display train connectioninformation only when the vehicle that the user is riding is a train.The train connection information can be acquired by the communicationsensor 7A and stored in the storage 8. As described above, thecontroller 6 can determine whether the vehicle that the user is ridingis a train on the basis of the detected value of the geomagnetic sensor.

At least one of the first sensor, the second sensor, and the thirdsensor may include a sensor identical to a sensor included in anotherone of the first sensor, the second sensor, and the third sensor. Inother words, the sensor included in the first sensor, the sensorincluded in the second sensor, and the sensor included in the thirdsensor may overlap. The sensor included in the third sensor may overlapwith the sensor included in the first sensor or the sensor included inthe second sensor.

In some embodiments, “changes the display form of the overlay imageautomatically” can include a configuration that prompts the user toselect whether to change the display form. In other words, when variousinformation included in the overlay image does not match the usageconditions of the electronic device 1, “changes the display form of theoverlay image automatically” refers to how a detailed setting operationfor changing the display form, such as having the user select thesituation or sensor information 8C on the settings screen to modify theinformation, is unnecessary. The controller 6 can, for example, causesthe display unit 3A to display the text “OK to switch display of overlayimage to underwater (on land) display?” as a pop-up display beforechanging the display form of the overlay image.

In another embodiment, the controller 6 may generate the overlay imageand then store the overlay image in the storage 8 without causing thedisplay unit 3A to display the overlay image. In other words, thecontroller 6 may generate the overlay image and then store the overlayimage in the storage 8 while causing the display unit 3A to display acaptured image on which overlay processing has not been performed.

In another embodiment, when the determined state is the first state(such as the electronic device 1 not being underwater), the controller 6may store first sensor information in the storage 8 in association withan image captured by the camera (imaging unit 5) in the state determinedto be the first state, without generating an overlay image. The firstsensor information is based on the detection result of one or moresecond sensors among the plurality of sensors (such as the communicationsensor 7A, barometric pressure sensor 7E, and temperature sensor 7F).When the determined state is the second state (such as the electronicdevice 1 being underwater), the controller 6 may store second sensorinformation in the storage 8 in association with an image captured bythe camera (imaging unit 5) in the state determined to be the secondstate, without generating an overlay image. The second sensorinformation is based on the detection result of one or more secondsensors among the plurality of sensors (such as the communication sensor7A, barometric pressure sensor 7E, and temperature sensor 7F) anddiffers from the first sensor information. After storage of the capturedimage is complete, the first sensor information or second sensorinformation stored in association with the captured image may beoverlaid on the captured image by user operation and then displayed onthe display unit 3A or stored in the storage 8 as the first overlayimage or the second overlay image.

The functions provided in the electronic device 1 may be implemented bya plurality of apparatuses. For example, the functions provided in theelectronic device 1 may be implemented by a first apparatus thatincludes at least the imaging unit 5 and a second apparatus thatincludes at least the display unit 3A. The first apparatus and thesecond apparatus are connected in a wired or wireless manner. The firstapparatus transmits at least an image captured by the imaging unit 5 tothe second apparatus in a wired or wireless manner. Either the firstapparatus or the second apparatus may perform the overlay processing onthe captured image. When the first apparatus performs the overlayprocessing, the first apparatus transmits the overlay image to thesecond apparatus in a wired or wireless manner. The second apparatusdisplays the received overlay image on the display unit 3A. When thesecond apparatus performs the overlay processing, the first apparatustransmits a captured image, on which overlay processing has not beenperformed, and the sensor information 8C to the second apparatus in awired or wireless manner. The second apparatus performs the overlayprocessing on the received captured image and displays the overlay imageon the display unit 3A. The first and second apparatuses may, forexample, be an action camera and a smartphone, or an action camera and awearable device, but these examples are not limiting.

The invention claimed is:
 1. An electronic device, comprising: adisplay; a camera; a plurality of sensors; and a controller configuredto determine a state of the electronic device on the basis of adetection result of a first sensor among the plurality of sensors, causethe display to display, when the determined state is a first state, afirst overlay image in which first sensor information based on adetection result of a second sensor among the plurality of sensors isoverlaid on an image captured by the camera, and cause the display todisplay, when the determined state is a second state, a second overlayimage in which second sensor information based on the detection resultof the second sensor among the plurality of sensors is overlaid on theimage captured by the camera, wherein the second sensor informationdiffers from the first sensor information, the first sensor informationand the second sensor information include numerical information and textinformation based on the detection result of the second sensor, the textinformation differs between the first sensor information and the secondsensor information, and the controller is configured to determinewhether the electronic device is underwater on the basis of thedetection result of the first sensor, cause the display to display thefirst overlay image when the electronic device is determined not to beunderwater, and cause the display to display the second overlay imagewhen the electronic device is determined to be underwater.
 2. Theelectronic device of claim 1, wherein the first sensor comprises anumber of sensors.
 3. The electronic device of claim 1, wherein thesecond sensor comprises a number of sensors.
 4. The electronic device ofclaim 1, wherein the first sensor comprises a sensor identical to asensor comprised in the second sensor.
 5. The electronic device of claim1, wherein the second sensor comprises a temperature sensor.
 6. Theelectronic device of claim 1, wherein the second sensor comprises abarometric pressure sensor.
 7. The electronic device of claim 1, whereinthe numerical information in the first sensor information and the secondsensor information are calculated on the basis of the detection resultof the second sensor, and a calculation method of the numericalinformation differs between the first sensor information and the secondsensor information.
 8. The electronic device of claim 3, wherein thesecond sensor comprises a temperature sensor.
 9. The electronic deviceof claim 8, wherein the second sensor further comprises a barometricpressure sensor.
 10. A method for controlling an electronic devicecomprising a display, a camera, a plurality of sensors, and acontroller, the method comprising: determining, using the controller, astate of the electronic device on the basis of a detection result of afirst sensor among the plurality of sensors; causing the display todisplay, using the controller, when the determined state is a firststate, a first overlay image in which first sensor information based ona detection result of a second sensor among the plurality of sensors isoverlaid on an image captured by the camera; and causing the display todisplay, using the controller, when the determined state is a secondstate, a second overlay image in which second sensor information basedon the detection result of the second sensor among the plurality ofsensors is overlaid on the image captured by the camera, wherein thesecond sensor information differs from the first sensor information, thefirst sensor information and the second sensor information includenumerical information and text information based on the detection resultof the second sensor, the text information differs between the firstsensor information and the second sensor information, and the methodfurther comprises determining whether the electronic device isunderwater on the basis of the detection result of the first sensor,causing the display to display the first overlay image when theelectronic device is determined not to be underwater, and causing thedisplay to display the second overlay image when the electronic deviceis determined to be underwater.
 11. A non-transitory computer-readablerecording medium including computer program instructions to be executedby an electronic device comprising a display, a camera, a plurality ofsensors, and a controller, the instructions causing the controller to:determine a state of the electronic device on the basis of a detectionresult of a first sensor among the plurality of sensors; cause thedisplay to display, when the determined state is a first state, a firstoverlay image in which first sensor information based on a detectionresult of a second sensor among the plurality of sensors is overlaid onan image captured by the camera; and cause the display to display, whenthe determined state is a second state, a second overlay image in whichsecond sensor information based on the detection result of the secondsensor among the plurality of sensors is overlaid on the image capturedby the camera, wherein the second sensor information differs from thefirst sensor information, the first sensor information and the secondsensor information include numerical information and text informationbased on the detection result of the second sensor, the text informationdiffers between the first sensor information and the second sensorinformation, and the instructions, when executed by the controller,cause the controller to further: determine whether the electronic deviceis underwater on the basis of the detection result of the first sensor,cause the display to display the first overlay image when the electronicdevice is determined not to be underwater, and cause the display todisplay the second overlay image when the electronic device isdetermined to be underwater.
 12. An electronic device, comprising: adisplay; a camera; a plurality of sensors; and a controller configuredto determine a state of the electronic device on the basis of adetection result of a first sensor among the plurality of sensors, causethe display to display, when the determined state is a first state, afirst overlay image in which first sensor information based on adetection result of a second sensor among the plurality of sensors isoverlaid on an image captured by the camera, and cause the display todisplay, when the determined state is a second state, a second overlayimage in which second sensor information based on a detection result ofa third sensor among the plurality of sensors is overlaid on the imagecaptured by the camera, wherein the controller is configured todetermine whether the electronic device is underwater on the basis ofthe detection result of the first sensor, cause the display to displaythe first overlay image when the electronic device is determined not tobe underwater, and cause the display to display the second overlay imagewhen the electronic device is determined to be underwater.
 13. Theelectronic device of claim 12, wherein the first sensor comprises anumber of sensors.
 14. The electronic device of claim 12, wherein thesecond sensor comprises a number of sensors.
 15. The electronic deviceof claim 12, wherein the third sensor comprises a number of sensors. 16.The electronic device of claim 12, wherein at least one of the firstsensor, the second sensor, and the third sensor comprises a sensoridentical to a sensor comprised in another one of the first sensor, thesecond sensor, and the third sensor.
 17. The electronic device of claim12, wherein the second sensor comprises an acceleration sensor or aposition sensor, and the third sensor comprises a temperature sensor ora barometric pressure sensor.
 18. A method for controlling an electronicdevice comprising a display, a camera, a plurality of sensors, and acontroller, the method comprising: determining, using the controller, astate of the electronic device on the basis of a detection result of afirst sensor among the plurality of sensors; causing the display todisplay, using the controller, when the determined state is a firststate, a first overlay image in which first sensor information based ona detection result of a second sensor among the plurality of sensors isoverlaid on an image captured by the camera; and causing the display todisplay, using the controller, when the determined state is a secondstate, a second overlay image in which second sensor information basedon a detection result of a third sensor among the plurality of sensorsis overlaid on the image captured by the camera, wherein the methodfurther comprises determining whether the electronic device isunderwater on the basis of the detection result of the first sensor,causing the display to display the first overlay image when theelectronic device is determined not to be underwater, and causing thedisplay to display the second overlay image when the electronic deviceis determined to be underwater.
 19. A non-transitory computer-readablerecording medium including computer program instructions to be executedby an electronic device comprising a display, a camera, a plurality ofsensors, and a controller, the instructions causing the controller to:determine a state of the electronic device on the basis of a detectionresult of a first sensor among the plurality of sensors; cause thedisplay to display, when the determined state is a first state, a firstoverlay image in which first sensor information based on a detectionresult of a second sensor among the plurality of sensors is overlaid onan image captured by the camera; and cause the display to display, whenthe determined state is a second state, a second overlay image in whichsecond sensor information based on a detection result of a third sensoramong the plurality of sensors is overlaid on the image captured by thecamera, wherein the instructions, when executed by the controller, causethe controller to further: determine whether the electronic device isunderwater on the basis of the detection result of the first sensor,cause the display to display the first overlay image when the electronicdevice is determined not to be underwater, and cause the display todisplay the second overlay image when the electronic device isdetermined to be underwater.